Residual Energies after Slow Quantum Annealing 
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Features of the residual energy after the quantum annealing are investigated. The quantum 
annealing method exploits quantum fluctuations to search the ground state of classical disordered 
Hamiltonian. If the quantum fluctuation is reduced sufficiently slowly and linearly by the time, the 
residual energy after the quantum annealing falls as the inverse square of the annealing time. We 
show this feature of the residual energy by numerical calculations for small-sized systems and derive 
it on the basis of the quantum adiabatic theorem. 
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Combinatorial optimization problems have presented 
a variety of challenges in vast area of sciences. Since the 
number of combination usually explodes exponentially 
with the number of elements, they becomes unsolvable 
for large elements by means of checking all of the combi- 
nations. In particular, no algorithm suitable for conven- 
tional computers has been discovered to solve the non- 
deterministic polynomial-time (NP) problem in a time of 
the polynomial order of elements. The quantum anneal- 
ing method has been proposed for such an intractable 
problem^]. 

The combinatorial optimization problem is often rep- 
resented in terms of a classical Hamiltonian, such as a 
random Ising model. What we do for the problem is to 
find the ground state of the classical Hamiltonian. In 
the quantum annealing method, a quantum Hamiltonian 
is introduced for a classical problem. Namely quantum 
fluctuations are exploited to search the solution. The 
principle of the quantum annealing method provides us 
a novel algorithm for quantum computation 0- Q In 
fact, fundamental experiments of quantum computation 
have been carried out0. Another importance of this 
method lies in implementation by conventional classical 
computers. The thermal (simulated) annealing is an well- 
known method for classical computers^. It has been 
shown experimentally that the quantum annealing sur- 
passes the thermal annealingQ. Hence the algorithm of 
quantum annealing in classical computers is expected to 
reduce the complexity of the problem. However it has 
been in question whether the exponential scaling law of 
the complexity regarding the problem size is replaced by 
the power law in the quantum algorithm. It is a great 
issue whether this algorithm can transform NP problems 
to polynomial-time solvable problems. 

In this letter, we investigate the asymptotic behavior of 
the residual energy for long annealing time. The residual 
energy is defined by the energy difference between the so- 
lution by means of an algorithm and the true one. If the 
scaling law of the asymptotic behavior with respect to the 
process time is unveiled, it becomes clear how efficiently 
the method leads us to the true solution. For instance, 



the residual energy after the thermal annealing decreases 
with the annealing (process) time as AE ~ l/(lnr)^ with 
1 < £ < 20, 0], and thus extraordinarily long time is 
needed to obtain a closely approximate solution. The 
logarithmic scaling law of the residual energy reminds us 
of the exponential law of the complexity. For the quan- 
tum annealing method, an earlier work has estimated 
that the residual energy falls as AE ~ l/(lnr) c with 
C ~ 60. However no one has confirmed numerically this 
scaling law of the residual energy after the quantum an- 
nealing. 

We examine the scaling law numerically in the present 
work. The result shows that the residual energy obeys 
power law, AE ~ with £ ~ 2 in the long r limit, 

in contrast to the earlier prediction. This asymptotic 
behavior is derived from the adiabatic theorem of the 
quantum mechanics. 

Let us consider a time-dependent Hamiltonian Ti.(t) 
which consists of the classical Hamiltonian H.q and the 
tunneling Hamiltonian Tix- The classical Hamiltonian 
denotes the energy function representing a combinatorial 
optimization problem, while the tunneling Hamiltonian is 
responsible for quantum effects. Detailed forms of these 
Hamiltonians are written later. We assume the time de- 
pendence of the Hamiltonian as follows. The tunneling 
term dominates the Hamiltonian at the initial time, and 
it vanishes at the final time. The Hamiltonian changes 
continuously in between the initial and final times. There 
is no symmetry at any time which brings about degen- 
erate ground states of the Hamiltonian. The quantum 
state vector stands for a solution of the combinatorial 
optimization problem in the quantum annealing method. 
The evolution of the state vector denoted by with 
the time t is determined by the Schrodinger equation, 
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We assume that the initial state is adjusted to the ground 
state of the initial Hamiltonian. It follows that the ap- 
proximate solution is obtained as the state vector after 
an evolution with the time when the Hamiltonian coin- 
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cides with the classical Hamiltonian. This is the process 
of the quantum annealing method. 

The validity of the quantum annealing method orig- 
inates in the adiabatic evolution of quantum mechani- 
cal states. The state evolving from the eigen state of 
the Hamiltonian almost retains being the eigen state. 
This dynamical process goes on when the change in the 
Hamiltonian with the time is sufficiently slow and the 
associated state is non-degenerate at any time. Hence 
the state starting from the ground state of the initial 
Hamiltonian arrives at an approximate ground state of 
the Hamiltonian at the final time. In the quantum an- 
nealing method, the final Hamiltonian is set to the classi- 
cal Hamiltonian. Thus the state vector at the final time 
becomes an approximate ground state of the classical 
Hamiltonian, namely the solution of the combinatorial 
optimization problem. 

Although we have imposed assumptions on the time 
dependence of the Hamiltonian, there are some degrees 
of freedom on that. We settle it as follows. First we 
denote an annealing time by r and consider the time 
period [0, r]. Taking into account the assumptions in the 
above, it is favored that the Hamiltonian at the initial 
time is identical to the tunneling Hamiltonian. This is 
because it is usually easy to make the exact ground eigen 
state of the tunneling Hamiltonian as will be seen later. 
Moreover it is natural to let the Hamiltonian depend on 
the time linearly, since the adiabatic theorem is proven 
for a Hamiltonian linear in the time. There is no strict 
insurance that the adiabatic theorem works correctly for 
the Hamiltonian with other time dependences. Thus we 
employ the following form of the Hamiltonian, 



H T {t) — -T~io 

T 



(2) 



Since the derivative of this Hamiltonian by the time is 
proportional to 1/r, the change of Hamiltonian involved 
by the time advance is infinitely slow in the infinite limit 
of r. Using this Hamiltonian, the adiabatic theorem en- 
sures that the final state converges to the ground eigen 
state of 7io in infinite limit of r. 

We note here that the Hamiltonian J5J is artificial. Al- 
though we are interested in the classical Hamiltonian 7io, 
the Hamiltonian does not include the contribution from 
Tlo initially. We emphasize here that the important thing 
is not how the intermediate state is but how the final 
state is after the evolution. Hence it does not matter 
that the Hamiltonian at the initial time differs entirely 
from TLq. 

For the sake of implementation of the quantum an- 
nealing, we consider two simple models as pilot cases. 
The first is a single-particle problem of the tight-binding 
model. Let us consider a one-dimensional lattice. We 
assume that there is one energy eigen-state at each site 
and the states in different sites are orthogonal each other. 
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FIG. 1: Results on the tight-binding model. Calculations 
were performed for the system with twenty sites, N = 20. 
Figure (a) shows the potential energy of each site. Figure 
(b) shows the annealing time dependence of residual energies. 
Results for several tunneling energies are plotted. A straight 
line, AE oc 1/r 2 , is shown for comparison. Note that both 
axes are logarithmic. For large r, the residual energy obeys 
the power law for the annealing time. The exponent is esti- 
mated to be approximately two. 



The classical Hamiltonian is given by 



N 



Wo = S)^|»)(i| 



(3) 



i=l 



where \i) denotes the single-particle state of the site i. N 
denotes the number of sites. Vi indicates the energy of 
the state at the site i. We assume Vi$ are randomly dis- 
tributed between and 1. The tunneling Hamiltonian of 
the present system is brought by hopping between near- 
est neighbor sites. It is written as 



N-l 



H T = -aJ2 (!»)<*+ 1| + I* + !)<*!) • 



(4) 



A positive parameter a denotes the strength of tunneling. 
The ground state of TCt as the initial state is given by 
l*0> = -^£f =1 K>; 

The next model is the random Ising spin model. The 
classical Hamiltonian is written as 



Ho 



Jy Sf Sj h S* , 



(5) 
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FIG. 2: Annealing time dependence of residual energies for 
the random Ising spin model. Two-dimensional lattice with 
nine spins are considered. Results are shown for several values 
of the transverse field. A line representing AE oc 1/r 2 is 
drawn for comparison. It is clear that the residual energy is 
fitted well by the line of AE oc 1/t 2 . The inset depicts bonds 
of the interaction and values of the coupling constant. 



where Sf is the z component of the spin operator at the 
site i. The coupling constant takes the value +1 or —1 
randomly. The Zeemann term with h — 0.1 is included so 
as to avoid that the ground state becomes doubly degen- 
erated. The tunneling Hamiltonian is introduced by the 
transverse field. Supposing a to be the transverse field, 
the Zeemann energy yields the tunneling Hamiltonian, 



(6) 



where Sf is the x component of the spin operator at the 
site i. All spins are fully polarized along the x axis in the 
ground state of Ttr- It follows from this that the initial 
state is written as |* ) = II J 775 (I t)t + I l)i)]> where 

T)i and I l)i are the eigen states of S* with the eigen 
values I and —h respectively. 

For each model we solved the Schrodinger equation |JTJ 
numerically using the Runge-Kutta algorithm of fourth 
order and obtained the time dependence of the state vec- 
tor. The residual energy is defined by the energy differ- 
ence between the energy expectation value with respect 
to the final state and the ground eigen energy of the clas- 
sical Hamiltonian, 



AE= (*(t)|Wo|*(t)> -E q 



(7) 



where Eq denotes the ground eigen energy of Hq. In 
our calculation, Eq is known because the system is small 
enough. 

We show results on the tight-binding model repre- 
sented by eqs. © and (@J in FigQ] The potential en- 
ergy at each site is randomly generated and is shown in 
Fij^a). Calculations ware performed for several tun- 
neling energies. Large value of a gives rise to the large 



energy gap at the initial time. Since the adiabatic theo- 
rem works better for larger energy gap, large a is prefer- 
able to lower the residual energy. However large a yields 
large derivative by the time of the Hamiltonian. Since 
large derivative disturbs the adiabatic evolution, large a 
is not preferable. Therefore there is an optimum a. In 
the present case, it seems around a = 0.6. 

It is seen in Fig^b) that the logarithm of residual 
energy decreases almost linearly with increasing the log- 
arithm of annealing time for long annealing time. There- 
fore the residual energy roughly obeys the power law with 
respect to the annealing time, 



AE oc -?. 
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(8) 



By comparison with the line AE oc r~ 2 drawn in the 
same figure, the exponent is estimated as C ~ 2. 

Results on the random Ising model given by eqs.© 
and JSJ are shown in FigEl The system consists of nine 
spins in the two-dimensional square lattice with nearest 
neighbor interactions. The values of coupling constants 
are indicated by the inset in the figure. Similar to the 
case in Fig^b), the residual energy is smallest at a cer- 
tain optimum a for a fixed r. It is clearly seen that the 
logarithm of residual energy is linear in lnr for long r. 
Hence the power law of the residual energy, eq.© 



AE 



1 



(9) 



holds also in the present case. Furthermore we can es- 
timate C ~ 2 by comparison with the straight line of 
AE cx 1/r 2 in the figure. This result is the same as that 
of the tight-binding model. 

From results of numerical calculations, we naturally 
infer that the power law with the exponent £ ~ 2 is the 
universal feature in the quantum annealing method. In 
fact, one can derive from the adiabatic theorem that this 
is true. According to a rigorous theory on the adiabatic 
theorem, the probability to find out the excited states of 
Hq in the final state is given bv|To) 



£|<n|*(T)}| 2 ~0 — 1 



(10) 



where \n) denotes the eigen state of Hq and n = in- 
dicates the ground state in particular, e has the dimen- 
sion of energy and defined by e = £ 2 nin /e' where e m - ln 
is the minimum of energy gap above the instantaneous 
ground state of H. T (t) and e' is the maximum of ma- 
trix element of Ht — T~to among instantaneous ground 
state and the lowest excited state of 7i T {t). The value 
of e' is of the order of the energy unit. Equation l|10|) 
holds for ct ^> 1. Formulas for each eigen state are 
derived, that is, |(n|*(r)}| 2 - 0(1/ (er) 2 ) for n ^ 
and |(0|*(r))| 2 - 1 - 0(1/ (er) 2 ). Hence, arranging the 
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eq.Q, we obtain that the residual energy is of the order 
of l/(er) 2 . 

AE = ^i?„|(n|*(r)}| 2 -i? (l-|(0|vl/(r))| 2 ) 

~ 0(7^5). (n) 

(er) 

where i?„ is the eigen energy of H.Q. Thus it is shown 
that the term proportional to 1 /r 2 dominates the resid- 
ual energy in the infinite limit of r. 

We note that eq. may contain higher order terms of 
1/ (er) than 1/ (er) . We attribute fluctuations around 
the line of AE oc 1/r 2 in FigQIb) to these additional 
terms. 

The existence of the energy gap above the instanta- 
neous ground state of Ti T {t) is crucial for the quantum 
annealing method. The argument on the basis of the 
eq.lJTDJ is incorrect when the ground state is degenerate 
at a time during the evolution. This is obvious because 
of e = 0. However the Hamiltonian of disordered sys- 
tems does not usually possess any symmetry which brings 
about degenerate ground state. 

We assume that the instantaneous energy gap is always 
finite. The value of e m i n depends on the problem. For 
problems with small e m i n , a large r is required in order 
to validate the power law of the residual energy. In other 
words, the quantum annealing method is more efficient 
for problems with larger e m i n . 

For er ~ 1, the adiabatic theorem does not work. In- 
stead the Landau-Zener theory should account for the 
transition between two states with close energies. Con- 
sider that the energy levels of instantaneous ground and 
first excited states come close together at a time. The 
excitation energy is locally minimized at this time. Ac- 
cording to the Landau-Zener theory ^3^3' the transi- 
tion probability from the ground state to the first ex- 
cited state is given by p ~ exp(— cer), where c is a con- 
stant of the order of unity. If such a possible transition 
occurs just once, the residual energy is proportional to 
exp(— cer). However it is not obvious whether this ex- 
ponential behavior is true for large systems, since the 
transition events may take place many times. 

Santoro et al. have predicted the logarithmic scaling 
law of the residual energy on the basis of the Landau- 
Zener theory 0. We remark that our result of power 
law is valid for r 3> 1/e where the quantum adiabatic 
theorem is guaranteed. Since the Landau-Zener theory 
is intended for r ~ 1/e, these two scaling laws may not 
conflict with each other. Nevertheless it should be noted 
that the definition of the residual energy in ref.0 is given 
by the expectation value of the excitation energy among 
the quantum annealing process. It is natural that the 
residual energy is defined by the energy expectation value 
of the final state measured from the true ground energy, 
eq.Q). Furthermore no one has confirmed numerically 



the scaling behavior for r ~ 1/e. In order to unveil the 
feature in this regime, numerical calculations for huge 
sized systems are desired. 

We remark on the implementation of the quantum 
annealing for combinatorial optimization problems with 
large elements. In order to carry out the quantum an- 
nealing, we must compute the real-time dynamics ac- 
cording to the Schrodinger equation. Methods of nu- 
merical calculation for the real-time quantum dynamics 
have not been developed enough except for cases of one- 
dimensional models. Construction of a general method 
is a big issue. One possibility exists in the quantum 
Monte-Carlo method. Even though direct computations 
of the real-time dynamics are impossible in the quan- 
tum Monte-Carlo method, one can regard an evolution 
by Monte-Carlo step as a fictitious-time evolution, some 
of earlier works have reported that the quantum anneal- 
ing with the quantum Monte-Carlo is more efficient than 
the thermal annealing|lL . However it is not clear that 
the adiabatic theorem works in the Monte-Carlo evolu- 
tion, the residual energy may show annealing time de- 
pendence different from real-time quantum annealing. A 
rigorous theory on the residual energy after the Monte- 
Carlo evolution is left as a future work. 
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